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A lensfree spectral light-field fusion microscopy (LSLFM) system is presented for enabling contrast- and 
resolution-enhanced imaging of biological specimens. LSLFM consists of a pulsed multispectral lensfree micro¬ 
scope for capturing interferometric light-field encodings at various wavelengths, and Bayesian-based fusion to 
reconstruct a fused object light-field from the encodings. By fusing unique object detail information captured at 
different wavelengths, LSLFM can achieve improved resolution, contrast, and signal-to-noise ratio (SNR) over 
a single-channel lensfree microscopy system. A five-channel LSLFM system was developed and quantitatively 
evaluated to validate the design. Experimental results demonstrated that the LSLFM system provided SNR 
improvements of 6-12 dB, as well as a six-fold improvement in the dispersion index (DI), over that achieved 
using a single-channel, resolution-enhancing lensfree deconvolution microscopy system or its multi-wavelength 
counterpart. Furthermore, the LSLFM system achieved an increase in numerical aperture (NA) of ~16% over 
a single-channel resolution-enhancing lensfree deconvolution microscopy system at the highest-resolution wave¬ 
length used in the study. Samples of Staurastrum paradoxum, a waterborne algae, and human corneal epithelial 
cells were imaged using the system to illustrate its potential for enhanced imaging of biological specimens. 

OCIS codes: (090.1995) Digital holography; (100.3175) Interferometric imaging; (100.2980) Image 

enhancement; (110.4234) Multispectral and hyperspectral imaging; (110.0180) Microscopy, 
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Optical microscopy remains an essential imaging tech¬ 
nique for many fields of research and technology. Vari¬ 
ous developments are underway in this field, with three 
irrrportant areas of development being: i) irrcreasing the 
field-of-view (FOV), ii) reducing instrument complexity, 
and iii) increasing imaging resolution. An emerging mi¬ 
croscopy modality that has shown considerable promise at 
addressing the first two areas is lensfree microscopy, where 
the concept of holographic imaging is harnessed to cap¬ 
ture interferometric light-held encodings without the need 
of lenses, from which complex object light-helds can be re¬ 
constructed from the encodings. By forgoing the need for 
lenses, the instrument complexity of lensfree microscopy 
systems can be greatly reduced while the FOV can be 
greatly increased. Given these attractive properties, there 
has been widespread interest in adaptation of such devices 
in helds such as biology, histology, particle distribution and 
motion, and water quality assessment EHl. One impor¬ 
tant caveat of lensfree microscopy systems is that imaging 
resolution is limited by the pixel pitch of the sensor array, 
making it difficult to rival traditional light microscopy sys¬ 
tems in terms of imaging resolution. To address this issue, 
a number of lensfree microscopy solutions based on syn¬ 
thetic aperture imaging and illumination source scanning 
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and angling have been proposed imi. However, such so¬ 
lutions require elaborate mechanical scanning equipment 
and more complex reconstruction algorithms that greatly 
increases the complexity and size of such systems. As such, 
an alternative mechanism for improving imaging resolution 
and contrast in lensfree microscopy without the need for 
elaborate mechanical scanning equipment is highly desired. 
One such approach is the resolution-enhancing lensfree de- 
convolution microscopy [l^ . which is widely accepted to 
be state-of-the-art in improving contrast and resolution be¬ 
yond the pixel pitch of the detector without the need for 
mechanical illumination scanning. 

One area that is not well-explored but holds significant 
promise for lensfree microscopy is the utilization of differ¬ 
ent wavelengths of light to capture different detailed in¬ 
formation about the sample being imaged. Recently, a 
few studies have proposed the use of three wavelengths 
in the visible band (red, green, and blue) as illumination 
sources for lensfree microscopy, with the primary focus 
of replicating irnages captured by traditional optical mi¬ 
croscopy [3, [S Ea [3 ■ Some recent works have also ex¬ 
plored the use of different wavelengths to improve phase 
retrieval [13, EEl- However, the study of how detailed 
information captured using different wavelengths can be 
leveraged to improve resolution and contrast in lensfree 
microscopy has not been well-explored. 

In this study, we aim to introduce a new lensfree spectral 
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Fig. 1. Experimental pulsed multispectral lensfree microscopy 
setup for lensfree spectral light-field fusion microscopy. LEDs 
at five different wavelengths are contained in the light source 
box (L) and pulsed to sequentially emit partially-coherent light 
(IcL). This light encounters a 200 fim aperture (P) and be¬ 
comes spatially coherent (CL), as a result of passing through 
the aperture, it is then imposed onto the sample (S). The in¬ 
terferometric light-held encodings at each wavelength are then 
generated on and recorded by detector (D), and sent to the 
digital signal processing (DSP) unit to perform Bayesian-based 
fusion to reconstruct the fused complex object light-held. 

light-held fusion microscopy (LSLFM) system for improv¬ 
ing imaging resolution and contrast in lensfree microscopy 
by leveraging unique detailed information associated with 
differing diffraction behaviour at different wavelengths. In 
LSLFM, a pulsed multispectral lensfree microscope first 
captures interferometric light-field encodings at different 
wavelengths. Based on the captured encodings and intrin¬ 
sic system properties, Bayesian-based fusion is then per¬ 
formed to reconstruct a fused complex object light-field 
with a higher resolution and contrast to improve sample 
detail visibility beyond what can be achieved at individ¬ 
ual wavelengths. The LSLFM system does not require any 
mechanical illumination scanning equipment and as such 
is especially attractive for applications outside of a labo¬ 
ratory environment where large FOV, high SNR and NA, 
and excellent image quality are paramount yet instrument 
complexity and size must be minimized. 

For this study, a five-channel pulsed multispectral lens¬ 
free microscope was developed (see Fig. [T] for experimen¬ 
tal configuration) to examine the efficacy of LSLFM for 
improved resolution, contrast, and SNR. A total of hve 
partially-coherent light emitting diodes (LEDs) were used 
as the pulsed multispectral light source with central wave¬ 
lengths ranging from the visible band to the near-infrared 
(NIR) band at Ai = 465 nm, A 2 = 525 nm, A 3 = 591 
nm, A 4 = 639 nm, and A 5 = 870 nm, with the spectral 
bandwidth being ± 30 nm. The LEDs in the pulsed light 
source were programmed to pulse using an Arduino mini 
controller board, with the duration of the pulsations set to 
maximize the signal observed on the detector while avoid¬ 
ing pixel saturation. The detector readout was synchro¬ 
nized with the LED pulsations, pending the appropriate 
exposure time, to facilitate for rapid and seamless acqui¬ 
sitions of interferometric light-field encodings at the five 
different wavelengths. The shortest exposure time was 750 
ms for A 2 = 525 nm and the longest was 1 s for A 5 = 870 
nm. These exposure times are directly related to the quan¬ 
tum efficiency of the detector, which has highest efficiency 
in the visible green range and the lowest efficiency in the 
NIR range, and to the power of the LEDs used in the 
pulsed multispectral light source. Note that this high ex¬ 
posure time is a major limitation of the present microscope 
configuration due to the light source and detector used 



Fig. 2. A region of the USAF resolution target captured using 
resolution-enhancing LDM system using Ai = 465 nm (a), A 2 = 
525 nm (b), A 3 = 591 nm (c), and A 4 = 639 nm (d). The 
same region captured using MWLDM system (e), and proposed 
LSLFM system (f). The SNR and the DI were assessed in a 
region shown by the red box. 

and not due to the LSLFM methodology, and improving 
both the light source and the detector will allow for much 
shorter exposure times for imaging dynamic events. 

The samples were placed on a microscope cover slip 
with a thickness of ^ 145 ^m and placed directly on the 
detector. Interferometric light-field encodings of the sam¬ 
ples were captured by the detector at the five different 
wavelengths using a 1600x1200 pixel CMOS sensor array 
with a pixel pitch of 4.5 ^m. The FOV of the pulsed mul¬ 
tispectral lensfree microscope is determined by the active 
sensor size and is ^ 35 mm^. 

Given the set of captured interferometric light-field en¬ 
codings, denoted by G = {^aIA G A} where A denotes the 
set of wavelengths A = {Ai, A 2 ,..., A„}, we introduce a 
Bayesian-based fusion procedure in the DSP unit for recon¬ 
structing a fused object light-field based on the unique 
diffraction behaviour at different wavelengths as captured 
in G, along with intrinsic system properties. The fusion 
procedure, which incorporates the statistical models first 
introduced in Q but for the fundamentally different prob¬ 
lem of reconstructing an object light-field from multiple 
interferometric light-field encodings, can be described as 
follows. The fused object light-field /0 can be defined as 
a weighted integral of a set of object light-fields at different 
wavelengths (denoted by F = {/a|A G A}): 

/© = / ( 1 ) 

JAeA 

where w\ is the integral weight of f\. Let the set of ob¬ 
ject light-fields at different wavelengths F and the set of 
captured encodings G be modeled as probability distribu¬ 
tions. The goal is to determine the weighted integral of the 
set of most probable object light-fields F given G, based 
on a priori information related to F, a priori information 
about the aberration transfer functions at each wavelength 
and the diffraction transfer functions at each wave¬ 
length {Hd,z,\)- This can be formulated as the following 
weighted integral optimization problem: 

/© = / wxargmaxf^ p{gx\fx)p{fx), (2) 
J\eA 
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Fig. 3. Selected region of the Staurastrum paradoxum sample 
captured with LDM system using Ai = 465 nm (a), A 2 = 525 
nm (b), As = 591 nm (c), and A 4 = 639 nm (d). The same re¬ 
gion captured using MWLDM system (e) and proposed LSLFM 
system (f). The scale bar denotes 40 /rm. 

where p{g\\f\) is the likelihood of captured encoding g\ 
given the object light-field fx and p{f\) is the prior of f\. 
Based on quantum photon emission statistics, p {g\\fx) can 
be expressed by: 


p(gx\fx) = n 

ses 




9x,. 


(3) 

where and 5'“^ denotes the forward and inverse Fourier 
transform, respectively, and S denotes a set of locations in 
the sensor array, with s S S' being a specific location in the 
sensor array. For the prior, we model f\ as a nonstationary 
process with a nonstationary expectation E{fx^s) and a 
variance 


P (/a) = 


n^- 

ses 


2t^ 


( 4 ) 


The weighted integral optimization problem posed in 
Eq. [2] is solved using the iterative optimization method 
described in [H, with the weights W = {wa|A S A} de¬ 
termined from the loading obtained via factor analysis [ 2 ^ 
to account for correlation structure across wavelengths. 

The efficacy of the proposed LSLFM system was vali¬ 
dated using the 1951 USAF resolution target, as well as 
samples of Staurastrum paradoxum (SP), a waterborne al¬ 
gae, and human corneal epithelial cells (HCECs). For com¬ 
parison purposes, a single-channel resolution-enhancing 
lensfree deconvolution microscopy (denoted here as LDM) 
system using the five different wavelengths was also real¬ 
ized using the same instrumentation setup as the LSLFM 
system, with the exception of the light pulsations and the 
DSP unit which are unique to LSLFM. The deconvolu¬ 
tion for the LDM system is achieved via the Maximum- 
likelihood method described in 0 , which is widely ac¬ 
cepted to be state-of-the-art for improving contrast and 
resolution beyond the pixel pitch of the detector without 
the need for mechanical illumination scanning. The Hyu- 
gens numerical diffraction transfer function and the same 
characterized aberration transfer function were used for 
both the LDM system and the LSLFM system for con¬ 


sistency. Furthermore, the iterative optimization meth¬ 
ods used in both the LDM and LSLFM system are both 
performed for 35 iterations for convergence, as suggested 
by 0 . In addition, a multi-wavelength variant of the 
LDM system, which we will refer to as MWLDM, is re¬ 
alized by combining the complex object light-fields pro¬ 
duced across multiple wavelengths using LDM via multi¬ 
wavelength averaging. 

Fig- m shows a zoomed-in region of the 1951 USAF res¬ 
olution target captured with the LDM system at four of 
the five captured wavelengths (Fig. [2Ka-d)). The same re¬ 
gion captured using the MWLDM system and the LSLFM 
system is shown in Fig. [5^ and Fig. [5f, respectively. It 
can be observed that, compared to the results obtained by 
the LDM system using different wavelengths, the results 
produced using the LSLFM system exhibits noticeable im¬ 
provements in contrast, resolution, as well as noticeable re¬ 
ductions in imaging artifacts. While the MWLDM system 
exhibits strong improvements in contrast and reduction in 
imaging artifacts compared to LDM, the LSLFM system 
is able to provide noticeable improvements in resolution. 

The imaging resolution of the LDM system at different 
wavelengths, the MWLDM system, and the LSLFM sys¬ 
tem were then determined based on the smallest element 
in which the vertical lines or the horizontal lines are re¬ 
solved. It was determined that the highest NA achieved 
by the LDM system is ~0.0703 computed at Ac = 465 nm, 
as the vertical lines of Group 7 Element I are resolved. In 
comparison, the LSLFM system achieves an NA of ~0.085, 
as the horizontal lines of Group 7 Element 2 are resolved, 
which is an improvement of ~I 6 % over LDM, which is the 
state-of-the-art in improving resolution without mechani¬ 
cal scanning. Furthermore, the MWLDM system achieves 
an NA of ^0.0703, as with LDM, and therefore the LSLFM 
system achieves an improvement of ~16% over MWLDM, 
which also illustrates that the resolution gains of LSLFM 
are not due to noise reduction and contrast enhancement 
from multi-wavelength averaging. 

The red box shown in Fig.[2f is the region where the SNR 
was assessed. The evaluated SNRs in dB are 15.03, 16.42, 
17.97, 20.75 for the LDM system using Ai, A 2 , A 3 , and 
A 4 , respectively. The MWLDM system achieves an SNR 
of 21.22 for the same region where as the LSLFM system 
achieved an SNR of 27.56 dB, resulting in an SNR gain of 
> 12 and 6 dB over the LDM and the MWLDM systems, 
respectively. Dispersion Index (DI), described in |2l| . was 
assessed for the same region to evaluate noise level, with 
lower DI indicating lower noise levels. The DIs achieved 
were 0.0115, 0.0109, 0.007, 0.0043 for the LDM system 
using Ai, A 2 , A 3 , and A 4 , respectively. The DI measured 
for MWLDM result is 0.0032. In comparison, the LSLFM 
system achieved a DI of 0.0007, which is six times lower 
than the best DI achieved using the LDM system and more 
than four times lower than the MWLDM system. 

To validate the functionality and merit of the LSLFM 
system, two biological specimens were imaged using the de¬ 
vice. An aliquot laboratory pure culture of SP, a common 
surface water algae, and a culture of immortalized HCEGs 
were selected as targets for image acquisition (shown in 
Fig. [3] and Fig. H]). 

Staurastrum paradoxum is an algae species belonging to 
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Fig. 4. A selected region of the human corneal epithelial cells 
captnred using LSLFM system with the equivalent FOV of a 
40X light microscope. The scale bar denotes 20 ^m. 

the Desmidiaceae family of green algae, commonly found 
in Canadian freshwater environments. A pure culture of 
this algae was obtained from the Canadian Phycological 
Culture Collection at the University of Waterloo. The cul¬ 
ture was propagated in an environmental growth cham¬ 
ber at 23°C in pre-sterilized BC-11 medium (2^ to which 
an aqueous solution of vitamins B12, biotin and thiamine 
was aseptically added. The culture flasks were kept under 
cool-white fluorescent lamps (300 - 400 /rE m“^ s“^ ) for 
one week to allow for initial growth and then transferred 
to lower illumination (200 - 300 /rE m“^ s“^) for slower 
growth and storage. 

The HCECs were maintained in keratinocyte medium, 
supplemented with keratinocyte growth supplement and 
Penicillin/Streptomycin at 37°C, 5% CO 2 , and 95% hu¬ 
midity. The cell culture medium was replaced every 2- 
3 days. The HCECs were cultured on 22x22 mm^ ^ 1 
coverslip one day before the imaging to allow for cells to 
adhere and spread on the coverslips. To prepare samples 
for microscopy, cells were fixed with 2.5% glutaraldehyde 
solution for two hours and subsequently were washed with 
phosphate buffer saline solution three times. 

Fig. [3] shows a selected region of the SP sample in the 
same order as presented in Fig. [3] As compared to the 
results obtained using the LDM system (Fig. [SKa-d)) and 
MWLDM (Fig. [SJ;), the results using the LSLFM system 
(Fig. [3f) has a noticeably higher contrast and resolution 
while the majority of imaging artifacts are suppressed. 
Many species of algae are used as surrogates and indicators 
of other algae or contaminants that may be present in wa¬ 
ter and can be harmful to human and ecosystem health. 
The LSLFM system developed herein has the potential 
to more efficiently and economically provide critical infor¬ 
mation for waterborne biological contaminant detection, 
enumeration, and identification. 

An image of the HCEC is shown in Fig. S) This fig¬ 
ure demonstrates a select region, a fraction, of the total 
FOV captured with the LSLFM system, with the equiva¬ 
lent FOV of a 40X light microscope denoted for context. 
The actual FOV captured by the LSLFM system is 140 
times larger than the FOV of a 40X light microscope. As 
such, the proposed LSLFM system can not only provide 
the tremendous advantage of a large FOV, but also may 


facilitate the observation of live cells in three-dimensional 
structures or seeded on thick or curved surfaces which is 
difficult to achieve with traditional optical microscopes. 
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